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Abstract 

Current  research  efforts  in  parallel  architecture  usually  evolve  from  a  design  of 
a  processor-memory-connection  architecture  with  rudimentary  facilities  for  synchron- 
ization and  communications,  which  are  often  found  to  be  inadequate  to  support  the 
more  sophisticated  usages.  In  order  to  remedy  this  problem,  we  favor  a  top-down 
design,  where  the  primitive  operations  are  selected  via  a  careful  and  thorough 
analysis  of  the  high-level  general  purpose  applications  to  be  supported  by  the  archi- 
tecture. 

In  this  paper,  we  study  how  a  high-level  process-synchronization  specification, 
presented  in  the  path  expression  language,  can  be  translated  into  a  fully  parallel  im- 
plementation on  an  MIMD  shared  memory  architecture  and  what  primitive  support 
facilitates  are  necessary  to  achieve  this.  Primary  emphasis  is  obviously  on  the  sim- 
plicity of  the  system,  low  synchronization  overhead  of  the  algorithm,  efficiency  of 
the  primitives  and  the  relative  ease  of  system  implementation. 
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1      Introduction 

Current  research  efforts  in  parallel  architecture  usually  evolve  from  a  design  of  a  piocessor-memory- 
connection  architecture  with  rudimentary  facilities  for  high-level  operations  such  as  synchronization, 
process  communication  and  context-switching.  Quite  often  the  rudimentary  facihties  are  later  found 
to  be  inadequate  to  support  the  more  sophisticated  usages,  and  the  final  product  suffers  from  a 
significant  loss  of  efficiency  and  simplicity.  It  is  therefore  imperative  that  the  machine  be  designed 
to  support  efficiently  the  intended  applications.  In  order  to  meet  this  goal,  we  favor  a  top-down 
design,  where  the  primitive  operations  are  selected  via  a  careful  and  thorough  analysis  of  the  high- 
level  general  purpose  apphcations  to  be  supported  by  the  architecture.  In  this  paper,  we  study  how 
a  specific  high-level  process-synchronization  protocol,  path  expression  language,  can  be  translated 
into  a  fully  parallel  implementation  on  an  MIMD  shared  memory  architecture  and  what  primitive 
support  facilities  are  necessary  to  achieve  this.  Primary  emphasis  is  obviously  on  the  simplicity 
of  the  system,  low  synchronization  overhead  of  the  algorithm,  efficiency  of  the  primitives  and  the 
relative  ease  of  system  implementation.  Many  existing  architectures  provide  primitive  facilities  to 
support  synchronization:  consider  Fetch&Add  instruction  on  the  Ultracomputer  or  Hep's  full-empty 
bit  logic.  However,  most  facilities  are  based  on  busy-waiting  protocols  (either  explicitly  by  the  user 
or  implicitly  by  the  system)  which  leads  to  memory  contention  resulting  in  poor  use  of  resources.  Our 
proposed  support  facilities  eliminate  this  bottleneck  while  allowing  for  straightforward  implementation 
of  algorithms  which  are  both  simple  and  efficient. 

Path  expressions  are  selected  as  our  language  of  synchronization-specification  because  of  its  high- 
level  of  abstraction  and  complex  semantics.  A  system  which  allows  for  efficient  implementation  of 
path  expressions  should  be  sufficiently  general  to  allow  for  efficient  implementations  of  less  complex 
synchronization  methods.  Specific  instances  of  path  expressions  systems  implement  important  syn- 
chronization protocols  such  as  readers-writers,  semaphores  and  monitors.  Moreover,  path  expressions 
have  served  as  the  basis  for  several  process  management  systems  [Shaw  1978],  [Lauer  et  al.  1979]. 
Studies  of  speciafized  synchronization  requirements  (readers-writers,  locking  schemes,  parallel  queues 
etc.)  may  be  found  in  the  literature  [Courtois  et  al.  1971],  [Gajski  et  aL  1985],  [Gottlieb  et  al.  1983], 
[Gottlieb  1986],  [Kruskal  et  al.  1986],  [Smith  1985].  However,  the  specialized  nature  of  these  solu- 
tions precludes  any  but  the  most  general  conclusions  to  be  drawn  about  the  ability  for  the  underlying 
architecture  to  support  more  general  synchronization  schemes.  We  feel  that  the  complexity  of  path 
expression  synchronization  encompasses  most  of  the  implementation  difficulties  of  these  more  spe- 
cialized protocols. 

Various  researchers  have  studied  the  implementation  of  path  expression  languages  for  se- 
quential systems  [Haberman  1975]  and  special  purpose  VLSI  systems  [Anantharaman  et  al.  1986], 
[Balraj  et  al.  1985],  [Li  et  al.  1984],  but  we  know  of  no  other  paralleHzed  implementation  of  such 
high-level  synchronization-specifications.  The  current  work  departs  significantly  from  the  approaches 
taken  by  other  researchers,  most  importantly,  in  how  the  arbitration  is  performed.  It  may  be  noted 
that,  whereas  there  is  no  way  to  guarantee  fair  arbitration  in  most  of  these  hardware-based  algo- 
rithms (if  no  delay-assumptions  about  the  circuit  elements  can  be  made),  it  is  possible  to  provide  a 
fair  implementation  on  a  parallel  computers.  We  also  believe  that  implementation  on  parallel  archi- 
tecture is  more  cost-effective  than  building  a  special  purpose  \'LSI  system  for  each  synchronization 
specification.  In  the  serialized  solution  presented  in  [IIal)erman  1975].  tlie  entire  path  expression  is 
locked  when  one  event  completes,  each  event  is  checked  in  turn  to  see  if  it  is  ready  to  execute  in  all 
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of  its  paths,  and  the  path  expression  is  unlocked.  This  requires  time  linear  in  the  size  of  the  path 
expression  in  order  to  make  a  decision  (although  all  possible  events  will  be  allowed  to  proceed  at 
this  point).  Our  solution  allows  a  large  number  of  possible  events  to  proceed  with  only  a  constant 
overhead. 

The  paper  is  organized  as  follows:  Sections  two  and  three  present  an  overview  of  path  expression 
synchronization,  followed  by  a  discussion  of  the  parallel  machine  model  to  be  used  in  this  paper.  In 
section  four,  we  present  the  basic  algorithm,  which  is  extended  in  the  following  section  to  provide 
bounded  fairness.  Section  six  discusses  the  portability  of  the  algorithms  presented  to  other  shared 
memory  MIMD  machines.  In  the  concluding  section,  we  remark  on  the  connection  between  this  work 
and  other  related  research  efforts  and  discuss  implications  our  results  may  have  for  other  currently 
proposed  parallel  machines.  Appendix  A  presents  some  simulation  results  of  the  size  of  independent 
sets  created  by  the  two  constant  time  independent  set  algorithms  and  compares  them  to  the  sizes  of 
maximal  independent  set  and  the  bounds  derived  analytically. 

2      Overview  of  Path  Expressions 

Path  expressions  provide  an  operation-based  method  of  performing  synchronization  among  commu- 
nicating processes  which  share  data  [Campbell  et  al.  1973],  [Haberman  1975].  Access  to  shared  data 
is  controlled  by  specifying,  via  a  system  of  path  expressions,  the  order  in  which  events  may  execute 
as  well  as  by  restricting  which  event  may  occur  concurrently.  Like  monitors  they  control  access  to  a 
fixed  set  of  events,  however  they  do  not  a  priori  stipulate  that  only  one  event  be  active  at  one  time 
[Hoare  1974].  This  added  flexibility  is  essential  to  fully  exploit  parallel  access  of  shared  resources. 

A  simple  path  expression  is  a  regular  expression  of  the  form  path  (  expression  )  end.  The  operators 
allowed  (in  order  of  precedence)  are  "+"  (Kleene  star),  "-|-"  (selection),  and  ";"  (sequential).  Selection 
signifies  that  either  operand  may  proceed,  but  not  both;  sequencing  restricts  the  second  operand  to 
follow  execution  of  the  first;  and  repetition  specifies  that  the  operand  may  occur  zero  or  more  times — 
the  path  ...  end  pair  is  an  inherent  repetition.  The  operands  are  events.  All  valid  execution  histories 
of  a  given  simple  path  expression  are  those  which  correspond  to  strings  in  the  language  defined  by 
the  expression.  Consider  a  scenario  in  which  there  is  a  producer  and  two  consumers  with  a  one-unit 
buffer.  Either  of  the  consumers  may  proceed  only  after  the  producer  has  produced  something.  This 
control  is  guaranteed  by  the  following  path  expression: 


path  produce:  A  consumes  +  B  consumes  end 


for  which  the  following  is  a  valid  execution  history: 

produce;  A  consumes;  produce;  B  consumes;  produce;  B  consumes;  ■■■ 

Because  a  path  expression  is  simply  a  regular  expression  it  has  a  corresponding  nondeterministic 
finite  automaton.  Each  state  has  a  corresponding  dependent  set  of  events  which  consists  of  the  set 
of  events  connected  to  the  state  by  out-transitions.  A  state  is  enabled  if  it  is  the  current  state;  once 
its  associated  event  completes  it  becomes  disabled.  At  any  point  in  time  at  most  one  state  in  the 
finite  automaton  may  be  enabled.  All  of  the  events  in  the  dependent  set  of  the  currently  enabled 
state  are  said  to  be  permissible;  based  on  the  constraints  imposed  by  the  path  expressions,  and  the 
external  world,  a  subset  of  the  permissible  events  will  be  selectable.   We  also  define  the  status  of  a 


Section  2 


Overview  of  Path  Expressions 


finite  automaton:  when  it  is  open  no  transition  is  enabled  and  one  must  be  selected  from  the  currently 
selectable  s'^t  of  events.  Otherwise,  it  is  closed  until  the  current  event  completes  and  the  transitioi. 
becomes  disabled. 

A  multiple  path  expression  is  a  set  of  simple  path  expressions  which  jointly  defines  the  concurrent 
operational  constraints  on  a  set  of  events.  An  event  a  is  selectable  if  and  only  if  there  is  an  state 
labeled  a  currently  permissible  in  all  of  the  path  expressions  in  which  a  appears.  Because  the  number 
of  path  expressions  in  which  an  event  appears  is  static,  there  is  a  paths  count  defined  for  each  event. 

One  may  describe  the  restrictions  specified  by  a  multiple  path  expression  by  a  conflict  graph 
[Anantharaman  et  al.  1986]  in  which  there  is  a  vertex  in  the  graph  associated  with  each  event.  An 
edge  between  two  vertices  signifies  that  they  must  be  executed  in  a  mutually  exclusive  manner  (i.e. 
their  executions  conflict).  At  any  point  in  execution  only  a  subset  of  the  conflict  graph  is  "hve," 
corresponding  to  the  currently  selectable  sets  of  events  of  the  open  simple  path  expressions.  The 
static  conflict  graph  for  the  following  multiple  path  expression  is  shown  in  Figure  1. 


path  (A  +  B  +  C);{D  +  E  +  F)  end 
path  iA  +  G):{C  +  D)  end 


Figure  1:  The  Static  Conflict  Graph. 

The  Figure  2  shows  the  permissible  and  selectable  sections  of  the  graph  when  both  simple  paths 
are  open  and  the  first  path  expression  is  in  its  first  state,  with  permissible  set  {A,B,C},  and  the 
second  path  expression  is  in  its  second  state,  with  permissible  set  {C.D}:  E,  F  and  G  are  not 
permissible  in  either  simple  path  expression.  Under  the  assumption  that  there  are  pending  requests 
for  the  events  .4.  B.  C  and  D,  the  set  of  selectable  events  is  {B,C}\  A  and  D  are  not  selectable 
because  they  are  not  permissible  in  all  the  path  expressions  in  which  they  appear. 


2.1      Semantics  of  Path  Expressions 

A  formal  semantics  for  path  expressions  can  be  given  in  terms  of  partially  ordered  multisets  {pom- 
sets)  of  events  as  in  [Pratt  1982]  and  [Anantharaman  et  al.  1986];  this  is  much  more  a  natural 
system  for  reasoning  about  path  expressions  than  other  semantic  devices  such  as  Petri  Nets  (see 
[Lauer  et  al.  1975]). 
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Figure  2:  The  Permissible  and  Selectable  Section  of  the  Conflict  Graph. 

First,  we  need  some  simple  definitions  from  the  theory  of  pomsets: 

A  partially  ordered  multiset  (briefly,  pomset)  over  a  finite  alphabet  S  is  a  triple  {Q,<,J^)  where 
(Q,<)  is  a  partially  ordered  set  and  T:Q  ~  E  is  a.  map  from  Q  into  S.  Intuitively,  a  pomset  can 
be  thought  of  as  a  directed  acyclic  graph  (not  necessarily,  finite)  in  which  each  node  is  labeled  with 
some  element  of  S.  Note  that  a  totally  ordered  pomset  can  be  simply  thouglit  of  as  a  sequence  of 
elements  of  S.  For  notational  convenience,  we  shall  use  subscripts  to  distinguish  different  elements 
of  Q  that  map  to  the  same  element  of  S. 

If  P  =  {Q,  <,T)  is  a  pomset  over  S,  and  S'  C  S,  then  the  restriction  of  P  to  S'  (denoted,  P|e') 
is  the  pomset  (Q',  <'..^')  where 

and  <'  and  T'  are  restrictions  of  <  and  T  to  the  domain  Q\  respectively. 

If  p  is  a  simple  path  expression  over  S,  then  Sp  C  E  denotes  the  sub-alphabet  of  all  the  letters  of 
E  that  occur  in  the  expression  p,  and  Lp  C  E*  is  the  regular  set  associated  with  p. 

A  trace  over  a  finite  alphabet  S  is  a  pomset  T  =  {Q,<,J^)  over  E  such  that  every  infinite  chain 
of  the  partially  ordered  set  {Q.,<)  is  an  w-sequence. 

An  element  q  £  Q  is  said  to  be  an  instance  of  an  event  a  G  E,  if  J-[q)  =  a. 
An  instance  q\  of  event  a\  precedes  an  instance  92  of  event  a2,  if  q\  <  q^  in  (Q,  <)• 
An  instance  q\  of  event  a\  is  concurrent  with  an  instance  92  of  event  02,  if  neither  instance  precedes 
the  other. 


•  Semantics  of  Path  Expression:  Let  p  be  a  simple  path  expression  with  event  set 
Ep.  A  trace  T  is  consistent  with  p  if  and  only  if  T\^  is  totally  ordered  and  every  finite 
prefix  o/T|vp  is  a  prefix  of  some  sequence  in  Cp  (the  regular  set  associated  icith  p.) 

If  -  —  pi  •  •  ■  pk  is  a  multiple  path  expression,  then  a  trace  T  is  consistent  with  ir  if  and 
only  if  it  is  consistent  iviih  each  simple  path  expression  pi  (1  <  i  <  k)  in  tt.  By  Tracev;(7r), 
we  denote  the  set  of  all  tracfs  consistent  with  n . 
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2.2      Correctness 

Given  an  implementation  of  the  path  expressions,  we  can  label  a  set  of  time  intervals  of  the  semi- 
infinite  interval  (starting  from  some  pre-determined  finite  instant  and  extending  to  infinity  1  as  follows: 
Correspo:iding  to  a  particular  instance  gi  of  an  event  oi,  consider  the  time  interval,  starting  from  the 
finite  instant  when  the  event  initiates  execution  (after  an  arbitration  module  determines  that  it  is  safe 
to  do  so)  and  ending  at  the  instant  when  the  event  is  completed  (if  the  event  is  never  completed  then 
the  interval  extends  to  infinity);  label  the  interval  by  the  event  oj.  Such  a  set  of  labeled  intervals 
will  be  called  an  execution,  S,  produced  by  the  implementation.  Define  Trace(o)  to  be  the  trace 
which  has  an  element  for  each  event  that  appears  in  the  execution,  and  has  the  obvious  partial  order 
induced  by  the  linear  order  on  time.  Note  that,  with  each  execution.  £,  of  the  implementation  (which 
is  influenced  by  the  requests  for  various  events  from  the  clients),  we  have  a  distinct  trace. 

In  order  to  establish  the  correctness  of  a  particular  implementation,  we  need  to  consider  the 
following  two  properties: 

•  Safeness:      The  implementation  produces  only  semantically  correct  traces. 

•  LiVENESS:      The  implementation  is  able  to  produce  any  semantically  correct  trace,  for 
some  behavior  of  the  external  world. 

However,  the  liveness  property,  as  stated,  cannot  be  demonstrated,  as  there  are  possible  traces  in 
Tracev;(7r)  (say,  T)  such  that  no  execution,  £.,  can  produce  Trace(f )  =  T.  To  circumvent  this  problem, 
we  introduce  the  notion  of  layered  traces,  and  introduce  a  seemingly  weaker  notion  of  liveness. 

A  trace  T  =  {Q,  <,  J^)  is  said  to  be  layered,  if  Q  can  be  divided  into  a  sequence  of  disjoint  subsets 
such  that,  for  any  q\,  q^  £  Q  {Qi  ^  Qi)^  9i  precedes  52  if  s^nd  only  if  the  subset  containing  qi  precedes 
the  subset  containing  92- 

We  use  the  following  notion  of  liveness,  in  the  proofs  of  correctness. 

•  Weak    Liveness:      The  implementation   is  able   to  produce  any  semantically  correct 
layered  trace,  for  some  behavior  of  the  external  world. 

3      Parallel  Machine  Model 

We  use  the  parallel  machine  model  similar  to  the  paracomputer  model  [Kruskal  et  al.  1986].  It  consists 
of  a  large  number  of  identical  processors  which  run  asynchronously,  each  executing  an  individual 
instruction  stream.  Processors  may  communicate  only  by  accessing  a  shared  memory  via  a  combining 
network.  In  order  to  efficiently  implement  the  path  expression  synchronization  algorithm,  we  have 
added  two  additional  memory  access  primitives,  which  we  discuss  below. 

Fetch&Op:  During  each  instruction  cycle  any  number  of  processes  may  access  the  same  location  in 
shared  memory.  In  addition  to  fetch-and-store  the  memory  interface  units  and  network  support  two 
Read-Modify-Write  instructions,  Fetch&Add  and  Fetch&Min  [Gottlieb  1986].  The  instructions 
have  the  following  semantics: 


FetcbS.:Add{a,i}:  a  —  a  +  i    then  return  a  —  i: 
FetcbS.:Min{a,i):  a  —  min(a,/)    then  return  previous  value  of  a: 
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All  merooiy  access  instructions  may  be  performed  simultaneously  on  the  same  memory  location: 
the  result  of  their  simultaneous  execution  is  identical  to  the  result  obtained  if  the  instructions  were 
executed  serially  in  some  unspecified  order.  Although  somewhat  unrealistic,  all  memorj  access  in- 
structions are  assumed  to  be  performed  in  one  instruction  cycle.  We  will  limit  our  use  of  FetchtAdd 
to  two  special  cases:  Fetchi:Inc(i)  and  Fetch&Dec(x),  which  are  simply  aliases  for  Fetchi:Add(2;, 
1)  and  Fetch&:Add(a:,  -1),  respectively. 

Signal/Wait:  The  memory  interface  units  have  been  further  enhanced  in  order  to  eliminate  busy- 
waiting  across  the  network.  A  simple  signal-wait  mechanism  is  provided  in  which  a  processor  must 
wait  until  it  receives  a  signal,  similar  to  the  full-empty  logic  in  the  HEP  [Smith  1985].  When  a 
processor  wishes  to  wait  for  a  signal  it  issues  a  wait  instruction  for  a  specific  location.  The  memory 
interface  unit  queues  the  request  if  there  is  no  signal  pending;  otherwise  it  returns  a  value  to  the 
processor.  When  a  process  signals  that  location,  one  or  more  waiting  process  will  be  freed.  The  two 
flavors  to  the  signal  instruction  (binary  and  counting)  correspond  to  the  two  traditional  signal/ wait 
protocols  where  either  one  or  all  waiting  processes  are  freed  on  the  result  of  a  signal: 


fajnarv'.ivait(a);  wait  at  a  for  matching  binary_sig  and  return  the  value  written  at  a 

binary^ig(a,  u):  write  value  n  to  memory  location  a  and  free  the  next  waiting  process 

counting.\ya.it{a):  wait  at  a  for  matching  counting^ig  and  return  the  value  written  at  a 

count ing^ig{a,n):  write  value  n  to  memory  location  a  and  free  the  next  n  waiting  processes 


Note  that  if  a  signal  A  has  not  yet  been  received  and  another  signal  B  is  sent,  signal  B  will 
overwrite  signal  A.  Clearly,  a  location  used  as  a  signal  should  be  accessed  only  by  a  given  signal/wait 
pair  of  instructions.  The  signal/wait  mechanism  requires  substantial  local  storage  for  maintaining 
queuest  of  waiting  processes  and  additional  logic  at  the  memory  interface  unit.  Moreover,  the  pro- 
cessor must  handle  the  delayed  return  of  the  result,  and  know  where  to  store  the  result  returned. 
This  is  fairly  simple  if  each  process  has  a  unique  set  of  registers  associated  with  it.  Otherwise,  it 
could  be  handled  by  a  special  interrupt  on  return  from  a  wait  instruction.  If  the  waiting  process  is 
resident  on  the  processor  the  value  is  stored  where  originally  requested.  If  not,  the  value  must  be 
stored  in  a  special  location  associated  with  the  process  (there  can  be  no  more  than  one  outstanding 
instruction  per  process).  This  additional  logic,  although  expensive,  eliminates  busy  waiting  across 
the  communication  channel — memory  access  is  no  longer  a  bottleneck  and  no  hotspots  are  created. 

4      Basic  Algorithm 

We  will  now  show  how  the  proposed  architecture  can  be  used  to  develop  an  efficient  algorithm  for 
path  expression  arbitration.  In  the  algorithm  being  presented,  the  controller  function  is  decentralized 
and  is  performed  in  parallel  by  a  set  of  modules.  The  modules  are  partitioned  into  three  classes:  an 
event  module  consists  of  passive  code  associated  with  a  specific  event;  a  path  expression  module  is  a 
process  associated  with  a  specific  simple  path  expression;  the  arbitration  modules  perform  arbitration 
among  the  requesting  processes.  The  event  module  is  used  to  process  event  requests  by  asserting  the 
request  and  then  waiting  for  a  signal  before  beginning  the  event;  as  well  as  to  notify  all  associated 
path  expressions  of  an  event's  completion.  The  path  expression  modules  maintain  the  current  state 
of  their  associated  finite  automaton.  They  must  detect  when  an  event  is  completed  and  perform  the 
appropriate  transition,  notifying  the  arbitration  modules.  The  arbitration  modules  take  the  informa- 
tion provided  to  them  about  outstanding  event  requests  and  path  expression  states  (provided  by  the 
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event  and  path  expression  modules  respectively)  and  use  this  information  to  make  the  arbitration 
decision.  In  making  a  decision,  a  live  conflict  graph  is  created  from  which  an  independent  set  is 
selected.  One  process  associated  with  each  event  in  the  independent  set  is  allowed  to  proceed.  The 
following  subsections  discuss  the  details  of  this  basic  algorithm.  The  subsequent  section  presents  a 
modification  of  this  algorithm  which  provides  fair  arbitration. 


4.1      Event  Module 

The  primary  responsibility  of  an  event  module  is  to  provide  process  request  information  to  the  arbi- 
tration module.  Processes  which  want  to  execute  a  given  event  execute  the  preamble  which  increments 
the  number  of  outstanding  requests  and  then  waits  for  a  signal  to  proceed.  Upon  completion  of  the 
event,  the  closing  is  executed  which  notifies  all  path  expression  in  which  the  event  appears  that  it 
has  completed.  Associated  with  each  event  process  are  variables  requests  (the  number  of  outstanding 
requests),  paths  (the  number  of  path  expressions  in  which  the  event  appears)  and  signals  arbitration 
and  event.done. 


Preamble  for  event  a: 

Fetch&Inc(requests[a]); 
binary.wait(arbitration[a]); 

Closing  for  event  a: 

count ing_sig(event.done[a],  paths) 


4.2      Path  Expression  Module 

A  path  expression  module  is  responsible  for  maintaining  the  current  state  of  its  finite  automaton. 
When  it  is  notified  by  the  event  module  that  the  currently  enabled  event  has  terminated,  it  sets  its 
flag  open  and  waits  for  a  decision  to  be  made  by  the  arbitration  modules.  When  a  decision  has  been 
reached  the  arbitration  module  notifies  the  path  expression  modules  which  wait  for  that  event  to 
finish.  Associated  with  each  path  expression  process  are  variables  curr^tate  and  open  and  signals 
transition  and  event.done. 


Path  expression  p: 

loop 

count  ing.wait(event.done[event]); 

open[;j]  —  true  ; 

event  —  buiary_wait(transition[p]); 

curr^tate[ji]  ^-  next(event,  curr_state[p]); 
end  loop  ; 


4.3      Arbitration  Module 

Although  the  event  and  path  expression  modules  run  completely  asynchronously,  the  arbitration  tasks 
run  synchronized:  they  combine  their  efforts  to  reach  an  arbitration  decision  based  on  the  current  live 
conflict  graph  for  the  multiple  path  expression.  There  are  two  types  of  arbitration  processes:  edge 
processes  and  vertex  processes.  Vertex  processes  are  associated  with  specific  events  and  maintain  the 
information  associated  with  the  events.   Edge  processes  correspond  to  an  edge  in  the  static  conflict 
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graph.  There  is  also  an  edge  defined  for  each  singleton  dependent  set  which  goes  from  the  vertex  in 
the  set  to  a  special  null  vertex.  If  there  are  redundant  edges  (e.g.  if  two  vertices  conflict  in  more  tiian 
one  dependent  set)  one  of  them  is  denoted  to  be  the  master.edge. 

The  general  outline  of  the  algorithm  is  to  loop  continuously  creating  independent  sets  of  live 
events  allowing  one  process  for  each  event  in  the  set  to  proceed.  First,  a  new  live  conflict  graph  is 
created  based  on  the  information  provided  by  the  event  and  path  expression  modules.  Then,  a  high 
throughput  independent  set  is  created  using  a  simple  independent  set  algorithm.  Finally,  one  process 
from  each  event  in  the  independent  set  is  signaled  and  the  path  information  is  updated.  At  the  end 
of  each  step  all  arbitration  processes  must  synchronize  before  commencing  the  next  step. 

Associated  with  each  edge  process  is  information  about  its  path,  state,  head  vertex,  tail  vertex 
and  update  duties  {state,  path,  head,  tail,  incJiead,  incJ^ait)  and  a  master.edge  flag.  Associated  with 
each  vertex  process  is  a  count  of  the  paths  in  which  the  corresponding  event  is  currently  permissible 
(permit),  and  a  flag  [indcp]  denoting  membership  in  the  independent  set.  A  vertex  v  is  a  member  of 
the  live  graph  if  and  only  if  it  is  selectable  (e.g.  \{  permit[v]  =  paths[v]  and  requests  is  greater  than 
zero).  This  condition  is  denoted  by  the  expression  live{v).  The  following  is  a  detailed  description  of 
each  step. 


Create  live  graph: 

Compute  the  current  live  section  of  the  graph  by  looking  at  the  status  of  each  path  expression 
and  request  information  for  each  event.  The  edges  w^hich  describe  the  conflicts  associated  with 
the  current  permissible  set  distribute  the  responsibility  for  incrementing  the  permit  count  for 
each  vertex  in  the  set.  Hence,  each  edge  may  increment  its  head  vertex,  tail  vertex,  neither  or 
both.  Then  the  number  of  live  vertices,  V,  and  the  number  of  live  edges.  E  are  calculated. 


Code  for  vertex  i: 

C 

Dcle  for  edge  e: 

wail  for  next  step; 

if  (open[path]  (c  currjstate[path]  =  state)    then 

\f  (tive{v))    then 

if  (inc.head)    then  Fetchi;Inc(permit[head]); 

Fetch&Inc(V); 

if  (inc.tail)    then  Fetchi:Inc(permit[tail]); 

end  if  ; 

end  if 

watt  for  fieri  step; 

if  (master.edge  L  /zt)e(head)  &  /u'e(tail))    then 

Fetchfclnc(£'); 
end  if  ; 

Select  an  independent  set: 

A  subset  of  live  vertices  is  selected  such  that  each  vertex  is  included  with  probability  l/k,  where 
^-  =  1  if  V  =  0  or  2^  <  V.  and  otherwise  k  =  2E jV .  The  selection  is  done  independently  by 
each  vertex  process.  If  any  two  vertices  in  the  subset  are  adjacent,  one  is  eliminated  at  random 
by  the  associated  edge  vertex.  The  resulting  set  of  vertices  is  an  independent  set. 
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Code  for  vertex  v. 

C 

ode  for  master  edge  e: 

\f  (hve{v))    then 

wait  for  next  step; 

indep[!']  ♦—  random 

< 

l/k 

if  (master.edge  k.  indep[liead]  &z  indep[tail])    then 

else  indep[f]  <—  false  ; 

if  (random  <  1/2)    then 

end  if  ; 

indep[head]  <—  false  ; 

waii  for  next  siep\ 

else     indep[tail]  —  false  ; 
end  if  ; 
end  if  ; 

•  Notification  of  event  and  update  patli  expression  information: 

Each  selected  event  is  notified  by  decrementing  tlie  requests  counter  and  signaling  one  of  the 
waiting  processes.  The  edges  compete  to  determine  who  notifies  their  path  expression  of  any 
enabled  event  and  to  reset  its  open  flag. 


Code  for  vertex  t : 

Code  for  edge  e: 

if  (indep[r])    then 

if  (indep[head]  or  indep[tail])    then 

binary_sig(arbitration[i'],  1); 

if  (Fetchi;Dec(open[path])  ^.^  0)    then 

Fetchi;Dec(requests[f]) ; 

Fetch<kInc(open[path]); 

end  if  ; 

else  if  (indep[head])    then 

permit[r]  —  0; 

binary^ig(transition[path],  head); 
else     binary^ig(transition[path].  tail); 
end  if  ; 
end  if  ; 

We  remark  that  a  race  condition  can  occur  in  the  above  implementation:  namely,  a  vertex  can 
receive  its  first  request  after  the  hve  graph  is  created  but  before  the  independent  set  is  determined. 
Although  it  is  not  included  in  the  count  of  live  vertices  V,  it  will  compete  to  be  in  the  independent 
set.  Clearly,  this  will  not  give  incorrect  results  and  can  easily  be  remedied  by  actually  having  a  flag 
live  which  is  set  once  per  arbitration  cycle  during  the  first  step. 

4.4      Safeness  and  Liveness  Issues 

It  is  clear  that  the  event  and  path  expression  modules  perform  their  limited  responsibilities  correctly. 
Because  of  the  complex  semantics  of  a  multiple  path  expression,  the  demonstration  of  the  correctness 
of  the  arbitration  process  is  somewhat  involved.  Essentially,  the  proof  relies  on  the  following  two 
observations: 


1.  For  every  simple  path  expression  only  one  valid  transition  may  be  performed  as  the  result  of 
any  decision  and  this  may  occur  only  when  the  associated  finite  automaton  is  open.  A  vahd 
transition  is  one  to  an  state  which  is  in  the  current  permissible  set. 

2.  For  any  event  to  proceed  it  must  bo  permissible  by  all  of  the  simple  path  expressions  in  which 
it  appears. 

These  two  requirements  are  guaranteed  by  the  choice  of  an  independent  set  of  vertices  of  the  given 
live  conflict  graph. 


10  Parallel  Algorithm  for  Path  Expressions 

Proposition  4.1  (Safeness  Properties)   Let  £  be  an  execution  of  the  algorithm  that  implements 
the  path  expressions  w.    Then 

T  ^  Trace(^)  6  Tracev(7r). 

PROOF. 

Assume  that  tt  =  ■  ■  -p-  •  •,  where  p  is  a  simple  path  expression.  Let  Sp  C  S  denote  the  sub-alphabet 

of  all  the  letters  of  S  that  occur  in  the  expression  p,  and  £p  C  E*,  the  regular  set  associated  with  p. 

We  first  claim  that  T|vp  is  totally  ordered.  Assume  to  the  contrary;  then  there  are  at  least  two 
distinct  events  oi,  02  €  Sp  such  that  their  respective  instances  ^i  and  72  are  concurrent.  When  Oi 
and  02  are  selected  it  must  be  the  case  that  permit[ai]  —  paths[ai]  and  permit[a2]  =  paths[a2].  Since 
p  is  included  in  both  paths[ai]  and  paths[a2]  (by  definition),  oi  and  02  must  both  be  permissible  in 
p  (otherwise,  at  least  one  of  the  two  conditions:  permit[ai]  =  paths[ai]  and  permit[a2]  —  paths\a2\, 
would  be  violated)  and  therefore  in  the  same  set  of  dependent  events.  This  implies  that  the  vertices 
corresponding  to  oj  and  02  must  be  present  in  the  live  conflict  graph,  together  with  an  edge  connecting 
them.  But,  the  implementation  of  the  parallel  arbitration  algorithm  ensures  that  at  least  one  of  the 
events,  oi  and  02,  would  be  excluded  from  the  selected  set.  This  contradicts  the  assumption  about 
the  concurrency  of  the  instances  q\  and  92- 

Since  the  path  expression  module  is  simply  an  implementation  of  the  finite  automaton  for  the 
regular  expression  corresponding  to  p,  and  since  every  finite  prefix  of  Tjvp  corresponds  to  a  valid 
sequence  of  state  transitions,  in  the  path  expression  module,  from  the  initial  state  to  the  current 
state,  it  follows  that  every  prefix  of  r|v^  is  also  a  prefix  of  a  string  in  Cp.    D 

Proposition  4.2  (Liveness  Properties)   Given  any  layered  trace  T  G  Tracev(7r),   the  algorithm 
will  produce  an  execution  £,  such  thai  Trace(c^)  =  T ,  for  some  behavior  of  the  external  world. 
PROOF. 

The  behavior  we  require  of  the  external  world  is  that  it  simultaneously  asserts  a  request  for  each 
event  a  in  the  first  subset  Si  of  T,  waits  for  the  corresponding  signals,  then  executes  all  the  events 
in  the  selected  set  S[  C  .S'l,  and  lastly,  simultaneously  executes  counting_sig{event.done[a],  paths)  for 
each  event  a  G  5{;  at  the  termination  of  this  cycle,  it  is  ready  to  repeat  a  similar  cycle  for  the  next 
subset  52  of  T,  and  so  on  with  5,"s. 

The  rest  of  the  proof  follows  from  the  two  observations,  below: 

•  At  the  beginning  of  the  i''*  cycle,  all  the  events  in  5,  are  selectable.  This  can  be  shown 
inductively,  by  considering  the  current  states  of  the  set  of  open  path  expression  modules. 

•  All  the  events  in  Si  are  selected  by  the  arbitration  module  to  proceed  to  execution,  i.e.  5,'  =  5,. 
First,  notice  that,  since  the  events  in  each  subset  5,  of  T  are  pair-wise  concurrent,  they  must 
be  such  that  no  two  of  them  belong  to  the  same  sub-alphabet  ^p,  where  p  is  a  simple  path 
expression  in  tt.  Consequently,  the  vertices  corresponding  to  each  event  in  5,  is  present  in  the 
live  conflict  graph,  with  no  two  of  them,  adjacent.  As  a  result,  each  vertex  is  chosen  with 
probability  1  (since  E  =  0)  and  no  vertex  is  excluded  from  the  selected  set  S'. 

Thus,  the  execution  £,  obtained  by  this  process  has  the  property  that  the  semi-infinite  time  interval 
can  be  partitioned  into  subintervals,  where  all  the  events  in  the  same  subset  5,  of  T  occur  concurrently 
in  the  ?"'  sub-interval.  Hence,  Trace(f )  =  T.    H 
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4.5      Fairness  Issues 

As  we  shall  show  in  the  next  subsection,  the  preceding  algorithm  provides  good  throughput;  however, 
it  does  not  guarantee  that  all  events  will  be  treated  fairly.  Although  Campbell  and  Haberman's 
definition  of  path  expressions  did  not  include  fairness  specifications,  it  is  obvious  that  any  solution 
presented  should  satisfy  some  notion  of  "fairness." 

However,  it  is  not  hard  to  see  that  there  can  be  no  implementation,  satisfying  the  strongest  from 
of  fairness  condition  (also,  known  as  impartiality,  see  [Lehman  et  al.  1979]),  i.e. 

•  Impartiality:     Each  event  is  infinitely  often  selected, 

since  the  path  expression  itself  may  constrain  the  synchronization  requirements  in  such  a  way  that  an 
event  may  be  requested,  but  never  selectable.  For  instance,  consider  the  following  path  expression: 


path  B\{B  +  C)  end 
path  (B+  C):B  end 


The  only  allowable  sequence  of  selected  events  is  BBBB  ■  ••,  since  the  configuration  (an  element 
of  the  cartesian  products  of  the  sets  of  states  of  the  automata  for  the  path  expressions)  in  which  C 
is  selectable  cannot  be  reached  from  the  initial  configuration.  Thus  no  implementation  of  the  path 
expressions  can  guarantee  that  the  event  C  will  not  starve. 

However,  our  implementation  does  satisfy  a  weaker  form  of  fairness  (known  in  the  literature  simply 
as  fairness): 

•  Fairness:     Each  event  is  either  almost  never  selectable  or  is  infinitely  often  selected. 

This  follows  from  the  observation  that  each  selectable  event  is  selected  by  our  algorithm  with  non-zero 
probability  p  =  l/k{l  —  l/'2k)'^  >  0,  where  k  is  a  parameter,  depending  on  the  live  conflict  graph  (as 
described  earlier)  and  d  is  the  degree  of  the  vertex,  corresponding  to  the  event,  in  the  live  conflict 
graph. 

We  say  an  event  is  blocked,  if  it  is  selectable  but  not  selected.  Note  that  the  basic  algorithm 
does  not  provide  any  guaranteed  bound  on  the  number  of  times  an  event  can  be  blocked,  before  it 
is  selected.  In  the  next  section,  we  shall  present  a  modified  algorithm  that  satisfies  a  more  desirable 
notion  of  fairness,  i.e. 

•  A'-Boi'NDED  Fairness:      The  number  of  times  any  event  is  consecutively  blocked  is  never 
more  than  k.  where  k  depends  only  on  the  number  of  events. 

We  remark  that  even  the  basic  algorithm  satisfies  a  condition  far  stronger  than  the  simple  fairness 
condition:  if  the  path  expression  specification  allows  some  configuration  Ct  to  be  reachable  from  the 
configuration  Cg,  then  the  basic  algorithm  preserves  this  reachability  property,  with  some  non-zero 
probabilily.  If  an  algorithm  satisfies  this  property  (which  we  call  weak  impartiality)  then  wc  say  that 
the  implementation  is  weakly  impartial.  Thus,  if  an  event  a  is  selectable  in  the  future  (from  the 
current  configuration)  then  by  weak  imi)aitiality.  our  algorithm  ensures  that  a  is  selectable  and  thus 
selected  with  some  non-zero  probability. 
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4.6      Complexity  Issues 

The  overhead  imposed  by  the  various  modules  is  a  small  constant  number  of  operations  (within  the 
processors,  the  memory  interface  units  and  across  the  network).  Although  there  are  a  few  global 
counters  (namely  V  and  E),  they  are  accessed  at  most  twice  per  process  during  each  arbitration 
phase  and  should  not  be  a  bottleneck.  The  throughput  of  the  system  and  the  process  utilization 
remains  high,  modulo  the  constraints  imposed  by  the  path  expressions  themselves. 

Proposition  4.3   At  each  arbitration  step,   the  expected  number  of  events  selected  is  no  less  than 

,  where  V  is  the  number  of  vertices  in  the  live  conflict  graph,  and  A  is  the  average  degree 

z  maxi^A,  1  y 

of  the  live  conflict  graph. 

PROOF. 

If  V  =  0  or  2E  <  V,  then  k  =  1,  the  number  of  the  live  vertices  is  \\'s\  =  V,  and  the  number  of 
edges  which  have  live  vertices  on  both  endpoints  is  \Es\  =  E.  Thus  the  expected  size  of  the  final 
independent  set  is 

Ei\is\)  =  |/.|  =  iv;i  -\E,\  =  v-E>  V  -Y-=L^Y., 

Otherwise,  k  >  1,  (since  V  >  0  and  2E  >  V).  Thus,  each  vertex  will  be  chosen  with  probability  1/k. 
The  expected  number  of  chosen  vertices  is: 

^(iv;i)  =  ^ 

and  the  expected  number  of  edges  which  have  chosen  vertices  on  both  endpoints  is: 

E       Vk/2        V 


E{\E, 


F  Jl-2  2k 


For  each  such  edge  we  will  eliminate  at  most  one  of  the  chosen  vertices.  Hence,  the  expected  size  of 
the  final  independent  set  is: 

£(17.1)  >ir(|v.|,-ir,ii:,i)  4-1,  =  ^. 

Note  that  the  average  degree  of  the  live  vertices  is  given  by 

_E„deg(r)  _  2E 
V         "    V-  ' 

and  k  =  max{A,  1},  and  E{\ls\)  >  ; 7.    D 

2  max{.\,  1} 

We  remark  that  this  throughput  should  not  be  confused  with  the  number  of  running  events,  since 
the  arbitration  proceeds  concurrently  with  the  other  running  events.  We  also  note  that  we  favor  a 
choice  of  large  independent  set  rather  than  a  maximum  or  maximal  independent  set,  since  the  system 
overhead  that  will  be  imposed  by  such  an  algorithm  is  unreasonably  high,  and  may  make  the  system 
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"unfair."  The  best  maximal  independent  set  algorithm^  that  we  know  for  such  a  system  has  a  time 
complexity  of  log  A  (where  A  =  the  maximum  degree  of  the  conflict  graph),  and  the  real  throughput 
of  this  algorithm  may  not  be  substantially  higher. 

The  degree  of  a  vertex  is  bounded  by  the  size  of  the  union  of  the  dependent  sets  in  which  it 
appears.  In  a  system  with  a  relatively  large  number  of  events  each  of  which  has  "localized"  conflicts 
(e.g.  it  only  competes  with  a  few  other  events)  our  constant  time  heuristic  should  give  good  results. 

In  the  Appendix  A,  we  include  some  empirical  results,  demonstrating  that  the  algorithm  behaves 
significantly  better  than  what  the  analytic  result  would  lead  us  to  expect.  In  particular,  this  algorithm 
produces  independent  sets  that  are  on  the  average  about  26%  better  than  what  the  proposition 
predicts.  Also,  in  a  particular  implementation,  it  may  be  advisable  to  repeat  the  arbitration  algorithm 
more  than  once;  for  instance,  repeating  the  algorithm  three  times  produces  independent  sets  that  are 
at  least  30%  of  the  maximal. 

5      Modified  Algorithm 

In  this  section  we  modify  the  basic  algorithm,  in  order  to  satisfy  the  /c-bounded  fairness  condition. 
We  first  introduce  the  notion  of  time  stamps  to  achieve  the  bounded  fairness.  The  only  routines 
which  will  be  modified  are  the  preamble  of  the  event  modules  and  the  algorithm  for  the  selection  for 
the  independent  set.  The  basic  structure  of  the  algorithms  remains  otherwise  identical. 

5.1      Event  Module 

We  will  introduce  a  global  variable,  time,  which  will  be  used  for  ordering  requests.  When  a  process 
wishes  to  execute  an  event,  it  gets  a  unicjue  time  stamp;  enqueues  that  time  stamp  on  the  parallel 
access  queue,  as  in  [Gottlieb  et  al.  1983],  which  is  associated  with  that  event;  and  then  waits  to  be 
signaled.  Hence,  the  modified  preamble  is  as  follows: 


Modified  preamble  for  event  a: 

enqueue(requests[a],  Fetch<klnc(time)); 
binary.wait(arbitration[o]); 


In  the  routine  which  updates  the  information  after  an  independent  set  has  been  selected,  the 
vertex  process  must  dequeue  the  time  from  the  queue  requests,  instead  of  simply  decrementing  it. 

5.2      Independent  set 

The  independent  set  algorithm  must  take  into  account  the  time  stamps  at  the  head  of  each  queue. 
The  vertex  associated  with  the  oldest  request  is  found  and  its  degree  is  noted  {do)  as  the  last  steps 
of  the  vertex  code  for  the  creation  of  the  live  graph.  A  value  k  is  chosen  to  be  1  if  V^  -  (fo  -  1  =  0  or 
2{E  -  do)  <  \'  -  do  -  \.  and  2(E  -  do)/(\'  -  do  -  I),  otherwise.  This  value  k  is  used  by  all  vertex 
processes  in  the  creation  of  the  independent  set. 


This  can  be  achieved  by  first  finding  a  A  +  1-coloring  of  the  static  conflict  graph  (using  an  algorithm  due  to 
[Goldberg,  A.  et  al.  1987])  and  then  choosing  a  maximal  independent  set  of  the  live  section  by  refining  the  color  classes 
using  a  technique  developed  by  [Goldberg,  M.  et  al.  1987]. 
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Modified  code  for  vertex  v  for  creating  the  live  graph: 

wait  for  nexi  step; 
if  {live {v))    then 

Fetchfclnc(V); 

Fetch&:Min(oldest,  qJiead(requests[t;])); 

end  if  ; 

wait  for  next  step; 

if  (oldest  =  qjiead(requests[v]))    then 

if  degree[t;]  =  V  —  1    then 
k  ^  1; 

else     k  ^-  max(l,  2(£'  —  degree[t)])/(l'  —  degree[i]  —  1)); 

end  if  ; 
end  if  ; 


The  vertex  associated  with  the  oldest  request  is  always  included  in  the  independent  set.  All  other 
vertices  are  selected  independently  with  probabihty  1/k.  If  any  two  vertices  in  the  subset  are  adja- 
cent, the  more  recent  request  is  eliminated.  The  resulting  set  of  vertices  is  an  independent  set.  The 
following  is  the  modified  code  for  the  creation  of  the  independent  set. 


Modified  code  for  creating  independent  set: 

Code  for  vertex  v. 

Code  for  edge  e: 

\f  (live{v))    then 

wait  for  next  step; 

if  (oldest  =  qjiead(requests[v]))    then 

if  (master.edge  k.  indep[head]  &  indep[tail])    then 

indep[i.']  ^-  true  ; 

if  (qJiead(requests[head])  > 

else     indep[r]  <—  random  <  1/k 

q.head(requests[tail]))    then 

end  if  ; 

indep[head]  ^-  false  ; 

else     indep[r]  —  false 

else     indep[tail]  ^  false  ; 

end  if  ; 

end  if  ; 

wait  for  next  step; 

end  if  ; 

5.3      Correctness  and  Fairness  Issues 

The  first  issue  which  must  be  addressed  is  the  handling  of  the  queue  of  time  stamps.  Although  there 
is  a  race  condition  in  the  preamble  of  the  event  modules  (that  the  queue  could  become  unordered), 
this  only  will  affect  the  fairness  argument,  but  not  the  liveness  or  safeness  properties.  We  define  the 
rank  of  a  process  to  be  its  position  in  the  temporally  ordered  list  of  processes  where  its  associated 
ranking  time  is  the  value  of  the  clock  time  when  it  executed  the  binary. wait{ arbitration)  statment 
in  the  preamble  of  the  event  module.  Although  this  time  does  not  strictly  correspond  to  the  time 
stamp  which  the  process  enqueued,  it  is  a  lower  bound  on  the  run  time.  A  process  is  guaranteed  that 
positions  ahead  of  it  in  the  queue  will  have  time  stamps  less  than  its  ranking  time.  Every  arbitration 
cycle  selects  the  selectable  event  with  the  lowest  associated  rank,  and  thus,  decrements  the  relative 
rank  of  every  other  process  waiting  for  a  selectable  event.  Therefore,  a  process  which  is  initially  of 
rank  r,  will  be  blocked  at  most  r  -  1  times.  Thus,  if  there  are  A'  processes  in  the  system,  any  process 
can  be  blocked  at  most  N  times,  (since  the  initial  rank  of  any  process  is  no  larger  than  N). 

However,  it  is  not  hard  to  see  that  the  modified  algorithm  does  not  possess  the  weak  impartiality 
property  because  it  may  no  longer  be  the  case  that  an  event  is  selectable  infinitely  often.  Our  modified 
algorithm  can  introduce  unwanted  starvation  into  the  system.  Consider  the  following  simple  path 
expression: 
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path  {A  +  B)\  ((yi;C)  +  (B;D))  end 


Assume  that  A,  B,  C  and  D  are  re  juested  continuously.  If  A  has  a  lower  time  stamp  than  B, 
then  at  the  first  step  A  will  be  selected,  followed  by  B  and  D,  and  subsequently  as  A  has  a  smaller 
time  stamp  than  B,  we  will  cycle  through  the  same  sequence  of  events.  Thus  the  trace  that  will 
be  generated  is  ABDABDABD  ■  ■  •,  forcing  C  to  starve.  Conversely,  if  A  had  a  higher  time  stamp 
than  B  then,  we  would  have  generated  BACBACBAC  ■  ■  •,  forcing  D  to  starve.  However,  the  trace 
AB D B AC AB D B AC  ■  •  •  is  a  valid  starvation  free  trace  for  the  path  expression. 

In  the  remaining  portion  of  this  subsection,  we  digress  to  discuss  a  simple  modifications  to  the 
algorithm  in  order  to  overcome  the  afore-mentioned  problem.  For  the  sake  of  readability  we  shall  use 
the  term  "modified  algorithm"  to  denote  the  algorithm  presented  in  the  previous  subsection,  and  not 
the  one  to  be  discussed  below. 

The  problem  really  lies  in  the  deterministic  nature  (however  slight)  of  the  arbitration  algorithm. 
A  naive  way  to  circumvent  this  problem  would  be  to  alternate  phases  of  some  constant  number  il/  >  1 
executions  of  basic  algorithm  with  phases  of  one  execution  of  the  deterministic  algorithm.  This  will 
still  guarantee  [M  +  l).V-bounded  fairness,  but  will  not  solve  the  problem  of  unwanted  starvation, 
as  one  can  see  from  the  following  example: 


path  [A  +  BYE"';  (^(A\C)  +  [B;  D)];  E"''^  end 


Now,  if  we  assume  that  A,  B,  C,  D  and  E  are  requested  continuously  then  our  new  algorithm 
will  producer  either  the  sequence 

ae^'bde^'-^ae^'bde^^-^ae^^bde^'-^  ■  ■  ■ 

or  the  sequence 

be^^ace^'-^be^'ace^^-^be^^ace^'-^--- 

In  either  event  again  either  C  or  D  will  be  forced  to  starve,  respectively.  A  starvation  free  trace  for 
the  above  example  is: 

be^'ace^'-\ae-^'bde^'-^be'^^ace^^-'^  •  ■  ■ 

If  M  is  chosen  to  be  sufficiently  large,  e.g.  larger  than  the  diameter^  of  the  graph  containing  all 
the  configurations,  with  the  neighbors  of  each  configuration  being  the  set  of  configurations  reachable 
in  one  step,  then  the  implementation  provides  both  (j1/  +  l)A'^-bounded  fairness  as  well  as  weak 
impartiality.  However,  in  the  worst  case,  M  can  be  exponentially  large  with  respect  to  the  total 
length  of  the  path  expression  specification,  and  the  result  would  only  be  of  theoretical  interest. 

But,  we  suspect  that,  in  practice,  for  all  but  few  pathological  examples,  a  much  smaller  value  of 
M  will  suffice.  For  instance,  for  almost  all  cases,  the  diameter  of  the  graph  of  configurations  would 
only  be  proportional  to  the  total  length  of  the  specification,  and  M  is  acceptably  small. 


^Diameter  of  a  directed  graph  G  is  defined  to  be 

diaiii  G  =  n\a\d{x,y), 

where  d{i,y)  is  the  length  of  a  shortest  directed  path  from  x  to  y. 
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Of  course,  the  most  realistic  solution  would  be  to  combine  both  the  algorithms  in  a  dynamic  and 
adaptive  man'ier:  for  example,  we  may  run  the  modified  algorithm  until  it  is  determined  that  the 
amount  of  starvation  in  the  system  is  unbearably  high;  such  a  situation  would  trigger  a  switch  to  the 
basic  algorithm;  after  a  'large'  number  of  phases  of  the  basic  algorithm,  we  return  to  the  modified 
algorithm. 

5.4      Complexity  Issues 

We  must  reconsider  the  throughput  by  looking  at  this  modified  independent  set  algorithm.    The 
overhead  remains  a  constant  number  of  operations. 

Proposition  5.1    At  each  arbitration  step,  the  expected  number  of  events  selected  is  no  less  than 


2max{2{E  -  do),{V  -  do-  I)}  -  2  max{A,Jo,  1}  ' 

where  V  and  E  are  the  numbers  of  vertices  and  edges,  respectively,  in  the  live  conflict  graph,  do  is 
the  degree  of  the  oldest  vertex  and  A  is  the  average  degree  of  the  live  vertices. 

PROOF. 

Let  0  <  ;:>  <  1  be  a  parameter,  denoting  the  probability  with  which  a  vertex  is  chosen;  we  shall  show 
that  the  average  size  of  the  independent  set  is  maximized  for  the  choice  p  =  1/k,  where  k  is 

max  <  1,2- 


T-c/o-l 
Since  each  vertex  is  chosen  with  probability  p,  the  expected  number  of  chosen  vertices  is: 

E{\V,\)=  l  +  (l--l)p 

and  the  expected  number  of  edges  which  have  chosen  vertices  on  both  endpoints  is: 

E{\Es\)  =  dop+iE-do)p\ 

For  each  such  edge  we  will  eUminate  at  most  one  of  the  chosen  vertices.  Hence,  the  expected  size  of 
the  final  independent  set  is: 

^(|/,|)     >     E{\V,\)  -  E{\Es\) 

=     1  +  (V  -do-l)p-{E-do)p^ 
=     {l-p){l-dop)  +  Vp-  Ep\ 

Clearly  the  expression 

F{p)  =  (1  -  p)(l  -  dop)  +  Vp  -  Ep"^ 

in  the  left  hand  side  is  maximized  for  the  value  of  p  =  1/A-.  and  the  value  is  no  smaller  than. 


Section  6  Portability  17 

The  rest  of  the  proposition  follows  if  we  show  that  for  some  p  =  1/fc'  (0  <  p  <  1), 

V 


Fip)  >  - 


2  max{A,rfo,  1} 

Choose  A-'  —  imx{dQ,2E /\\  1).  Then  there  are  three  cases  to  consider: 
•  Case  1.     Assume  that  1  >  msix{do,2E/\'}: 
Then  do  =  0,  and  'IE  <  l\  and 

F{p)  =  V  -E>1-^  ^ 


2        2max{A,f/o,l}' 


•  Case  2.     Assume  that  2£'/r  >  max{f/o.  1}: 
Then 


[-2  rT.'2 


V  \  f        doV\       i'2       E\ 


> 


2EJ  \        2E  J      2E       AE^ 
V  V 


4E/V       2nmx{A,doA}' 


•  Case  3.     Assume  that  do  >  max{2£'/r,  ]}: 
Then 


do  V         do\' 

r  _  r 

-     2d^~  2ma\{\.doA}' 

U  do  >>  A  the  throughput  may  become  quite  poor.  However,  more  than  half  of  the  vertices 
have  degree  less  than  2A;  ^  thus  in  half  of  the  arbitration  phases  the  throughput  will  be  no  less  than 
half  of  the  throughput  obtained  using  the  basic  algorithm.  Intuitively,  we  may  expect  the  modified 
algorithm  to  introduce  a  degradation-factor  of  at  most  four,  over  the  basic  algorithm. 

The  empirical  results  in  the  Appendix  A  demonstrate  that  the  modified  algorithm  produces  in- 
dependent sets  that  are  on  the  average  about  42%  better  than  what  is  predicted  analytically.  A 
surprising  result,  obtained  from  simulation,  was  that  this  algorithm  produced  independent  sets  that 
are,  on  the  average,  6%  better  than  the  previous  algorithm!  This  is  due  to  the  fact  that  in  the 
modified  arbitration  algorithm,  the  conflicts  are  resolved  in  a  more  consistent  manner  using  the  time 
stamps. 

6      Portability 

In  this  section,  we  explore  the  question  of  portability  of  the  arbitration  algorithm  to  other  MIMD 
shared  memory  m.achines.    The  primary  i)roblems  are  the  implementation  of  the  FetchirOp  and 

Using  Markov's  Inequality,  we  see  that  the  probability  that  the  degree  of  a  vertex  is  no  smaller  than  2.\  is  bounded 
from  above  by  j. 
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signal/ wait  instructions.  Clearly  the  signal/ wait  instructions  could  be  emulated  by  stan^^ard  signal- 
wait  routines  which  are  generally  provided  by  the  operating  system.  This  will  in  general  impose  a 
substantial  increase  in  overhead  due  to  waiting  (either  through  overloading  the  memory  channel  or  in 
forcing  a  context  switching),  but  will  provide  a  correct  solution.  FetchL'Op  can  be  emulated  simply 
by  enclosing  the  two  operations  in  a  critical  section.  This  could  lead  to  serious  degradations  due  to 
serialization,  but  is  simple  to  implement  given  mutual  exclusion  primitives  provided  by  the  run  time 
system.  In  both  of  these  situations,  one  is  forced  to  rely  on  the  supporting  software  to  guarantee 
fairness  and  efficiency.  A  more  interesting  problem  is  that  of  the  ease  of  porting  the  algorithm  to 
other  MIMD  shared  memory  machines  which  provide  some  hardware  support  for  synchronization. 
The  emulation  routines  should  closely  mirror  the  special  synchronization  support  already  provided. 
In  the  following  section  two  machines  will  be  considered:  the  Denelcor  HEP  and  Cedar. 


'e> 


6.1      HEP 

First,  we  consider  the  HEP  architecture  and  its  fuU-empty  bit  synchronization  mechanism  [Jor83, 
Smi83].  Associated  with  each  location  in  memory  is  a  bit  which  may  be  used  for  synchronizing  access 
to  that  location.  If  that  location  is  defined  to  be  "synchronous",  there  are  two  rules  which  must 
be  followed  when  accessing  it.  When  reading  from  a  location  the  full-empty  bit  must  be  initially 
full.  After  the  value  is  read,  the  bit  is  set  empty  in  one  atomic  step.  This  testing  and  subsequent 
retrying  of  the  bit  is  handled  entirely  by  the  memory  access  unit:  control  is  returned  to  the  user 
process  only  after  the  value  has  been  read  and  the  bit  is  set  empty.  Conversely,  when  writing  to  a 
synchronous  location  the  bit  must  be  initially  empty;  after  the  write  is  complete,  the  bit  is  set  full. 
This  mechanism  guarantees  strict  alterations  of  reads  and  writes  to  specific  memory  locations  and 
can  be  used  to  write  simple  synchronization  routines. 

Because  there  exists  no  dual-operation  instructions,  the  Fetch&Op  operations  must  be  simulated 
in  software  using  the  following  routines: 


Fetcbl:Add(adr.  value)  : 

FetchSsMin(adr,  value)  : 

old.value  <—  read(adr); 

old.value  ~-  read(adr); 

write(adr,  value  -f  old.value); 

if  (value  <  old.value)    then 

return  old.value; 

write(adr,  value); 

else     write(adr,  old.value); 

end  if 

return  old.value; 

The  location  adr  must  be  defined  to  be  synchronous  and  be  accessed  only  through  these  routines 
(or  other  routines  which  perform  alternating  read-writes).  Initially  the  full-empty  bit  associated  with 
adr  is  set  to  fuU.  After  a  process  performs  a  read,  no  other  process  may  access  that  variable  (because 
we  are  forcing  reads  before  writes)  until  after  the  process  writes  to  it.  Therefore  each  routine  remains 
atomic. 

The  wait/signal  instructions  have  a  more  direct  implementation.  The  binary  signaling  routine 
is  implemented  simply  by  defining  the  message  variable  to  be  synchronous.  The  implementation 
of  counting_wait/counting_sig  requires  two  variables,  one  which  acts  as  the  counter  and  the  other 
as  a  temporary  variable.  As  with  the  implementation  of  the  Fetchi:Add  routine,  the  variable  adr 
must  be  defined  to  have  the  fuil-ompty  logic  activated  and  must  only  be  accessed  using  these  routines. 
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counting.\vait{adr)  : 

count ing^ig{adr)  : 

valut  ^-  read(adr); 

write(adr,  n); 

if  (value  >  0)    then 

write(adr,  value 

1)^ 

end  if  ; 

The  bit  for  adr  is  initially  set  empty.  The  decrementing  oi  adr  guarantees  that  all  n  processes  will 
be  signaled.  The  primary  drawback  of  these  implementations  is  that  the  HEP's  memory  access  unit's 
retry  algorithm  uses  neither  time  stamps  nor  aging;  clearly  this  strongly  effects  the  starvation  and 
fairness  attributes  of  the  algorithm.  In  order  to  insure  bounded  fairness,  one  would  need  to  provide 
queues  for  each  of  these  routines:  only  the  process  at  the  head  of  the  queue  would  be  able  to  perform 
the  routines  described  above. 

6.2      Cedar 

Another  machine  of  interest  is  the  Cedar  multiprocessor  [Gaj83,  GaP85].  It  has  a  location-tag  scheme 
similar  to  the  HEP,  but  more  powerful  in  certain  respects.  Memory  locations  may  be  defined  to  be 
synchronization  variables  which  consist  of  key  and  data  parts.  There  is  a  synchronization  instruc- 
tions, sync,  which  has  the  following  syntax  and  semantics  : 


sync(nc/r,  [cond.op,  vaL]],  [key.op,  vaL2],  [dala.op,  vaLS]) 

\{  (adr. key  cond.op  vaLl  )    then 

perform  key..op  on  adr. key  and  vaL2 
perform  daia.op  on  adr. data  and  vaL3 
return  true 

else     return  false 

end  if 


Operations  allowed  on  data  are  fetch,  store  or  no.op;  operations  in  the  key  are  fetch,  store,  in- 
crement, decrement,  incremcnt-and-fetch,  decrement-and- fetch  and  no-op.  However,  retrying  the  key 
condition  is  the  responsibility  of  the  user.  The  following  routines  are  used  to  implement  Fetchi;Op: 


FetchSsInc{adr,  value)  : 

return(sync(adr,  [no.op,  0^ 

,  [increment 

,0] 

,  [no.op,])  -  1  ); 

FetchA:Min{adr,  value)  : 

while  (not  sync(adr 
if  (old.vahie  i  value 

)    then 

[increment 

0],  [fetch 

old.vahie]))  loop  ; 

sync(adr,  [no 
else     sync(adr,  [no 
end  if  : 

-op,  0], 
-op,  0], 

[decrement, 
[decrement. 

0]. 
0], 

[no.op 
[store, 

0]); 

value]); 

return(old_value); 
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The  wait-signal  emulation  has  an  interesting  solution.  We  want  to  maintain  a  queue  of  waiting 
processes  and  then  signal  them  either  one-by-one  or  in  a  group.  The  counting.wait/counting^ig 
routines  simply  use  the  key  of  a  synchronization  variable  to  perform  signaling.  Two  synchronization 
variables  are  needed  to  perform  the  binary  wait/signal.  One  variable's  key  is  used  to  maintain  a 
count  on  the  processes  waiting.  The  other  is  used  to  notify  the  next  waiting  process  and  to  transfer 
the  value.  The  binary  .wait,  binary_sig,  counting.wait  and  counting^ig  instructions  are  emulated  by 
the  following  four  routines: 


count ing.wait{adr)  : 

while  (not  sync(adr,  [>,  0].  [decrement,  0],  [no.op,  0]))  loop  ; 

counting^sig{adr,  value)  : 

sync(adr,  [no.op,  0],  [store,  value],  [no_op,  0]); 

binary.wait{adrl ,  adr2)  : 

sync(adrl,  [no.op,  0],  [increment-fetch,  myJd],  [no.op,  0]); 
while  (not  sync(adr2,  [=,  niyjd],  [no.op,  0],  [fetch,  value]))  loop  ; 

binary.sig(ac/r2,  value)  ; 

sync(adr2,  [no.op.  0],  [increment,  0],  [store,  value]); 


All  variables  must  by  synchronous  and  accessed  only  through  these  routines.  Both  of  these 
solutions  are  very  simple  and  provide  fair  solutions.  Moreover,  the  overhead  is  negligible  if  processes 
do  not  need  to  wait.  However  they  all  require  busy-waiting  across  the  network  which  can  lead  to 
network  congestion  and  greatly  reduce  the  throughput  of  the  machine. 

7      Conclusion 


In  this  paper,  we  demonstrated  that  a  high-level  synchronization  specification  presented  in  the  path 
expression  language  can  be  efficiently  translated  into  a  fully  parallel  implementation  on  an  MIMD 
shared  memory  architecture,  if  the  architecture  is  embelhshed  with  simple  'Fetch&Add'  and  'Sig- 
nal/Waitfor'  primitives  which  are  shown  to  be  easily  implementable.  Moreover,  the  simplicity  of  our 
translation  algorithm  allows  one  to  develop  a  powerful  system  with  a  small  amount  of  additional 
work. 

Clearly,  the  system  can  be  easily  ported  to  any  other  MIMD  shared  memory  machine  if  the 
'FetchirAdd'  and  'Signal/Waitfor"  primitives  can  be  efficiently  emulated  in  that  architecture.  Stan- 
dard solution  to  the  emulation  problem  is  via  some  form  of  critical-section  and  signal-wait  mechanisms, 
which  could  be  assumed  to  be  provided  by  the  operating  system.  But  invariably  almost  all  of  these 
systems  will  force  serialization  within  the  critical  section,  frequent  context  switching,  and  overload- 
ing of  the  connection  network.  A  more  interesting  problem  is  to  consider  the  ease  of  porting  the 
algorithm  to  available  parallel  machines,  and  how  well-suited  their  synchronization  primitives  are  for 
the  purpose.  We  have  investigated  these  issues  for  two  architectures:  the  Denelcor  HEP  and  Cedar 
[Jordan  1985],  [Smith  1985],  [Gajski  198.3],  [Gajski  et  al.  1985].  In  case  of  the  HEP,  the  synchroniza- 
tion primitive  is  provided  by  an  empty-full  bit  mechanism  which  allows  synchronizing  access  to  each 
memory  location.    It  is  difficult  to  implement  a  solution  with  bounded  fairness,  because  the  HEP 
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retrying  algorithm  does  i  ot  use  time  stamps  or  aging.  In  Cedar,  the  synchronization  is  achieved  by  a 
location-tag  scheme  (similar  to  the  HEP  but  somewhat  more  powerful)  and  a  synchronization  instruc- 
tion, sync.  It  is  possible  to  achieve  a  simple  and  fair  solution  at  the  expense  of  busy-waiting  across 
the  network,  a  situation  which  can  lead  to  network  congestion  and  greatly  reduce  the  throughput 
of  the  machine.  Implementation  on  a  massively  parallel  SIMD  architecture  such  as  the  Connection 
Machine  was  also  considered.  Although  there  is  a  simple  mapping  for  the  synchronous  arbitration 
module,  there  was  no  efficient,  straight-forward  implementation  of  the  event  and  path  expression 
modules  which  are  based  on  the  asynchronous  client/server  model.  We  leave  it  as  an  open  problem 
to  find  a  simple  and  efficient  solution  for  SIMD  architectures. 

We  believe  that  the  work  presented  here  opens  a  new  research  direction:  namely,  that  of  designing 
a  parallel  architecture  in  a  top-down  fashion  starting  with  a  careful  study  of  high  level  systems.  Such 
a  research  direction  has  also  been  proposed  in  a  rather  general  term  in  [Siegel  et  al.  1986];  this 
research  was  conducted  within  framework  of  the  Metanode  Project,  and  was  influenced  by  many 
ideas  contributed  by  other  members  of  the  project  -  most  specifically,  by  Alan  Siegel. 
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A      Empirical  Results 

This  section  describes  some  results  of  simulation  of  the  independent  set  algorithms.  Simulation  was 
performed  to  see:  1 )  how  the  algorithm  performed  as  compared  to  the  analytic  expected-case  bounds; 
2)  how  the  algorithm  compared  to  actual  maximal  independent  set  sizes;  3)  how  quickly  the  algorithm 
converged  to  a  maximal  independent  set.  Simulations  were  performed  on  a  variety  of  different  graphs 
to  compare  the  performance.  For  each  base  graph  used,  50  simulation-runs  were  performed  and  the 
statistics  gathered  were  averaged.  Each  simulation-run  consisted  of  the  following  steps: 

1.  A  live  graph  is  created  by  each  vertex  deciding  whether  or  not  to  be  "live"  based  on  a  certain 
probability. 

2.  Simple  independent  sets  are  created  and  evaluate  by  performing  the  following  substeps: 

2.1  An  independent  set.  /i ,  was  created  from  the  live  graph  by  running  the  basic  independent 
set  algorithm  once. 

2.2  The  independent  set  algorithm  is  repeated  two  times,  thus,  creating  a  second  indepen- 
dent set,  I3. 

2.3  A  maximal  independent  set,  /max.  is  created  (whicli  includes  all  the  vertices  in  the 
independent  set  I3.) 

2.4  The  size  of  the  sets  /j  and  I3  are  compared  to  the  set  /max- 

3.  Steps  2.1  -  2.4  are  repeated,  using  the  modified  independent  set  algorithm  and  the  original 
live  graph. 

In  general,  the  results  were  very  good.  The  independent  sets  created  by  the  basic  constant 
time  algorithm  were  on  the  average  26%  larger  than  expected  (the  independent  sets  of  the  modified 
algorithm  were  42%  larger  than  expected).  Moreover,  the  size  of  the  independent  set  produced  by  the 
modified  algorithm  averaged  6%-  larger  than  that  produced  by  the  basic  algorithm.  Because  conflicts 
are  resolved  based  on  time  stamps,  not  simply  a  random  choice,  the  modified  algorithm  resolves 
conflicts  more  consistently.  In  addition,  the  algorithms  appear  to  converge  quickly.  The  size  of  the 
set  after  three  iterations  of  the  algorithm  averaged  more  than  twice  the  size  of  the  original  set.  These 
numbers  were  fairly  constant  throughout  all  graphs  which  were  analyzed.  However,  the  relative  size 
of  the  sets  selected — as  compared  with  the  size  of  the  maximal  set — varied  greatly  as  the  base  graph 
configuration  was  changed.  Three  classes  of  graphs  were  examined,  each  of  which  performed  quite 
differently.  The  following  is  a  description  of  each  class  as  well  as  the  detail  performance  of  the  two 
algorithms.  In  all  cases  vertices  were  live  with  probability  either  .25  or  .75.  The  labels  in  the  following 
charts  have  the  meanings  described  below: 


£■(/):  Bound  on  tlie  expected  size  of  the  independent  set,  obtained  analytically. 

Ii'.  Size  of  independent  set  after  one  iteration. 

/i%:  Percentage  of  the  size  /i  to  the  size  of  /max- 

I3:  Size  of  independent  set  after  three  iterations. 

/3%:  Percentage  of  the  size  I3  to  the  size  of  /max- 

Prob:  Probability  of  a  vertex  being  alive  (either  0.2.5  or  0.75). 


Dining  philosophers:  This  graph  is  a  ring  in  wliich  each  philosopher  vertex  connected  to  its  /  nearest 
vertices  on  either  side  (where  2/  is  the  number  of  forks).  The  case  of  n  philosophers  which  need  2  forks 
to  eat  is  simply  a  singly  threaded  ring.  Ring  based  graphs  are  representative  of  path  expression  conflict 
graphs  because  each  event  conflicts  with  a  few  local  events.  The  results  below  describe  four  simulations. 
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In  ail  runs  there  were  1000  vertices  (philosophers).  In  the  first  two  Ccises,  each  philosopher  needs  2  forks; 
in  the  other  two  cases  they  need  10  forks  (5  from  the  right  and  5  from  the  left). 


Basic 

Modified 

Forks 

Prob 

E{I) 

h 

/3 

h% 

h% 

E{I) 

h 

h 

h% 

h% 

2 

.25 

123 

189 

194 

0.97 

1.00 

119 

185 

190 

0.95 

0.98 

2 

.75 

249 

279 

370 

0.72 

0.95 

214 

270 

359 

0.70 

0.92 

10 

.25 

49 

60 

90 

0.59 

0.89 

42 

56 

85 

0.56 

0.86 

10 

.75 

49 

59 

98 

0.46 

0.77 

45 

58 

97 

0.46 

0.76 

Reader- Writers:  These  graphs  consist  of  reader  and  writer  vertices.  Writer  vertices  are  connected  to 
all  other  vertices;  reader  vertices  have  no  interconnection.  Hence,  the  writer  vertices  from  a  complete 
subgraph  and  are  connected  to  all  reader  vertices.  Three  cases  of  reader-writer  graphs  were  modeled: 
"pure"  readers-writers  with  many  (999)  readers  and  1  writer;  "few"  readers-writers  with  many  (900) 
readers  and  few  (10)  writers;  and  "even"  readers-writers  with  an  even  number  of  readers  and  writers 
(100).  The  following  are  the  results  of  the  simulations. 


Basic 

Modified 

Rds  Wrs 

Prob 

E(I) 

h 

/3 

h%. 

h% 

E{I) 

h 

h 

h% 

h% 

999    1 

.25 

124 

211 

249 

0.85 

1.00 

124 

208 

249 

0.84 

1.00 

999    1 

.75 

374 

470 

747 

0.63 

1.00 

374 

476 

744 

0.64 

0.99 

500    10 

.25 

24 

33 

69 

0.27 

0.56 

24 

39 

73 

0.32 

0.59 

500    10 

.75 

13 

21 

70 

0.06 

0.19 

12 

21 

70 

0.08 

0.21 

100    100 

.25 

0 

0 

1 

0.30 

0.47 

0 

1 

2 

0.45 

0.49 

100    100 

.75 

0 

0 

1 

0.39 

0.59 

0 

1 

2 

0.43 

0.44 

Random:  Several  varieties  of  random  graphs  were  created.  In  each  graph  there  were  1000  vertices.  The 
minimum  and  maximum  degrees  of  the  vertices  were  varied  to  create  difff-rent  base  graph  types.  Sparse 
graphs  were  created  (with  average  degree  logn)  with  each  vertex  having  degree  between  5  and  15. 
Dense  graphs  were  created  (average  degree  n/  log  n)  with  each  vertex  having  degree  between  80  and  100. 
Average  graphs  were  created,  with  each  vertex  having  degree  between  20  and  50.  The  following  are  the 
results  of  the  simulations. 


Basic 

Modified 

Degree 

Prob 

E[I) 
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h 

/,% 

h% 

E(I) 

h 

h 

/i% 

h% 

5-15 

.25 

50 
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0.82 
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59 
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0.49 
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0.57 

45 

58 
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0.55 

80-100 

.25 

5 

6 

14 

0.20 

0.40 

4 

7 

14 

0.22 

0.43 

80-100 

.75 

5 

7 

14 

0.15 

0.31 

4 

7 

14 

0.17 

0.32 

20-50 

.25 

13 

17 

34 

0.26 

0.52 

12 

17 

34 

0.27 

0.52 

20-50 

.75 

13 

16 

35 

0.17 

0.37 

12 

17 

35 

0.18 

0.37 

In  all  graphs,  as  the  number  of  live  vertices  increases,  the  algorithm  decreased  in  performance. 
This  is  because  conflicts  are  handled  very  naively;  as  the  number  of  conflicts  increased,  more  vertices 
were  omitted  from  the  independent  set.  The  worst-case  behavior  occurs  when  many  vertices  are 
connected  to  a  small  subset  of  vertices  (as  in  readers-writers).  Because  connectivity  is  high,  each 
vertex  enters  with  small  probability.  This  behavior  would  also  be  exhibited  by  other  algorithms  in 
which  inclusion  in  the  independent  set  is  based  on  the  degrees  of  the  vertices.  One  should  note 
that  the  algorithm  performed  relatively  well  on  the  random  graphs  (which  are  perhaps  the  most 
important).  In  this  case  the  independent  set  found  after  three  iterations  of  the  algorithm  was  always 
at  least  30%  of  the  maximal. 


